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Abstract 



We study the Gaussian multiple-input multiple-output (MIMO) wiretap channel, 
which consists of a transmitter, a legitimate user, and an eavesdropper. In this channel, 
K^ ' the transmitter sends a common message to both the legitimate user and the eaves- 

dropper. In addition to this common message, the legitimate user receives a private 



message, which is desired to be kept hidden as much as possible from the eavesdrop- 
per. We obtain the entire capacity-equivocation region of the Gaussian MIMO wiretap 

^D \ channel. This region contains all achievable common message, private message, and 

private message's equivocation (secrecy) rates. In particular, we show the sufficiency of 
jointly Gaussian auxiliary random variables and channel input to evaluate the existing 

k> , single-letter description of the capacity-equivocation region due to Csiszar-Korner. 
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1 Introduction 

We consider the Gaussian multiple-input multiple-output (MIMO) wiretap channel, which 
consists of a transmitter, a legitimate user, and an eavesdropper. In this channel, the trans- 
mitter sends a common message to both the legitimate user and the eavesdropper in addition 
to a private message which is directed to only the legitimate user. There is a secrecy concern 
regarding this private message in the sense that the private message needs to be kept secret 
as much as possible from the eavesdropper. The secrecy of the private message is measured 
by its equivocation at the eavesdropper. 

Here, we obtain the capacity-equivocation region of the Gaussian MIMO wiretap channel. 
This region contains all achievable rate triples {Rq, Ri, Re), where Rq denotes the common 
message rate, Ri denotes the private message rate, and Re denotes the private message's 
equivocation (secrecy) rate. In fact, this region is known in a single-letter form due to pLj. 
In this work, we show that jointly Gaussian auxiliary random variables and channel input 
are sufficient to evaluate this single-letter description for the capacity-equivocation region 
of the Gaussian MIMO wiretap channel. We prove the sufficiency of the jointly Gaussian 
auxiliary random variables and channel input by using channel enhancement [2] and an 
extremal inequality from [3]. In our proof, we also use the equivalence between the Gaussian 
MIMO wiretap channel and the Gaussian MIMO wiretap channel with public messages [H 
Problem 33-c], [5]. In the latter channel model, the transmitter has three messages, a 
common, a confidential, and a public message. The common message is sent to both the 
legitimate user and the eavesdropper, while the confidential and public messages are directed 
to only the legitimate user. Here, the confidential message needs to be transmitted in perfect 
secrecy, whereas there is no secrecy constraint on the public message. Since the Gaussian 
MIMO wiretap channel and the Gaussian MIMO wiretap channel with public messages are 
equivalent, i.e., there is a one-to-one correspondence between the capacity regions of these 
two models, in our proof, we obtain the capacity region of the Gaussian MIMO wiretap 
channel with public messages, which, in turn, gives us the capacity-equivocation region of 
the Gaussian MIMO wiretap channel. 

Our result subsumes the following previous findings about the capacity-equivocation 
region of the Gaussian MIMO wiretap channel: i) The secrecy capacity of this channel, 
i.e., max Ri when Rq = 0, Re = Ri, is obtained in PE] for the general case, and in [8] for the 
2-2-1 case, ii) The common and confidential rate region under perfect secrecy, i.e., (i?o,-Ri) 
region with Re = Ri, is obtained in [9]. iii) The capacity-equivocation region without a 
common message, i.e., {Ri,Re) region with Rq = 0, is obtained in [5]. iv) The capacity 
region of the Gaussian MIMO broadcast channel with degraded message sets without a 
secrecy concern, i.e., {Rq, Ri) region with no consideration on Re, is obtained in [10]. Here, 
we obtain the entire {Rq, Ri, Re) region. 



2 Discrete Memoryless Wiretap Channels 

The discrete memoryless wiretap channel consists of a transmitter, a legitimate user and an 
eavesdropper. The channel transition probability is denoted by p{y, z\x), where x G A" is the 
channel input, y & y is the legitimate user's observation, and z E Z is the eavesdropper's 
observation. We consider the following scenario for the discrete memoryless wiretap channel: 
The transmitter sends a common message to both the legitimate user and the eavesdropper, 
and a private message to the legitimate user which is desired to be kept hidden as much as 
possible from the eavesdropper. 

An (n, 2"^°, 2"-^^) code for this channel consists of two message sets Wo = {1, . . . , 2"-^"}, 
Wi = {1, . . . , 2'^-^^}, one encoder at the transmitter / : Wo x Wi — t- X"', one decoder at the 
legitimate user (?« : 3^" — t- Wo x Wi, and one decoder at the eavesdropper ge : 2" — )■ Wq. 
The probability of error is defined as P^ = m.ax{P^^,P^^}, where P^^ = Pr[(7„(F") 7^ 
{Wq,Wi)],P^], = PT[ge{Z"-) 7^ Wq], and Wj is a uniformly distributed random variable in 
Wj, j = 0, 1. The secrecy of the legitimate user's private message is measured by its 
equivocation at the eavesdropper [HHI], i.e., 

-H{W,\Wo,Z^) (1) 

n 

A rate triple {Rq, Ri, Re) is said to be achievable if there exists an {n, 2"^°, 2"^^) code such 
that lim„^oo Pe = 0, and 

Re= lim -H{Wi\Wo,Z'^) (2) 

n— )-oo n 

The capacity-equivocation region of the discrete memoryless wiretap channel is defined as 
the convex closure of all achievable rate triples (-Ro) ^ii Re), and denoted by C. The capacity- 
equivocation region of the discrete memoryless wiretap channel, which is obtained in [1] , is 
stated in the following theorem. 

Theorem 1 ( [H Theorem 1]) The capacity- equivocation region of the discrete memoryless 
wiretap channel C is given by the union of rate triples {Ro,Ri,Re) satisfying 

0<Re<Ri (3) 

Re<I{V;Y\U)-I{V;Z\U) (4) 

Ro + Ri< I{V] Y\U) + min{/([/; Y), I{U; Z)} (5) 

R^<min{I{U;Y),I{U;Z)} (6) 

for some U, V, X such that 

U -^V ^X ^{Y,Z) (7) 



We next provide an alternative description for C. This alternative description will arise as 
the capacity region of a different, however related, communication scenario for the discrete 
memoryless wiretap channel. In this communication scenario, the transmitter has three 
messages, Wo,VFp,VFs, where Wq is sent to both the legitimate user and the eavesdropper, 
and Ws, Wp are sent only to the legitimate user. In this scenario, Wg needs to be transmitted 
in perfect secrecy, i.e., it needs to satisfy 

lim -I{Ws; Z", Wo) = (8) 

n— ^oo n 

and there is no secrecy constraint on the public message Wp. To distinguish this communi- 
cation scenario from the previous one, we call the channel model arising from this scenario 
the discrete memoryless wiretap channel with public messages. We note that this alternative 
description for wiretap channels has been previously considered in [H Problem 33-c], |5]. 

An (n, 2"-^'', 2"^'', 2"-^°) code for this scenario consists of three message sets Wo = {!,..., 
2"^«}, Wp = {1, . . . , 2"^''}, Ws = {1, . . . , 2'^^=}, one encoder at the transmitter / : Wo x 
Wp X Ws -> A"", one decoder at the legitimate user s^u : 3^" -> Wo x Wp x W^, and one 
decoder at the eavesdropper ge : -Z" — )• Wo- The probability of error is defined as P^ = 
max{P-,,Pj;j, where P", = Pr[(7„(y") ^ iWo,Wp,Ws)] and P,", = Pr[geiZ^) ^ Wo]. A 
rate triple [Rq, Rp, Rg) is said to be achievable if there exists an (n, 2"-^", 2"^'', 2"-^') code such 
that lim„^oo Pe — ^"^^ ® is satisfied. The capacity region Cp of the discrete memoryless 
wiretap channel with public messages is defined as the convex closure of all achievable rate 
triples {Ro,Rp,Rs). The following lemma establishes the equivalence between C and Cp. 

Lemma 1 (Po, Rp, Rs) G Cp iff {Rq, Rs + Rp, Rs) e C. 

The proof of this lemma is given in Appendix \M Using Lemma [U and Theorem [1], we can 
express Cp as stated in the following theorem. 

Theorem 2 The capacity region of the discrete memoryless wiretap channel with public 
messages Cp is given by the union of rate triples {Rq, Rp, Rg) satisfying 

0<Rs<I{V;Y\U)~I{V;Z\U) (9) 

Po + Pp + P. < I{V; Y\U) + min{/(f/; Y),I{U; Z)} (10) 

Ro<mm{I{U;Y),I{U;Z)} (11) 

for some {U, V, X) such that 

U ^V ^X ^{Y,Z) (12) 



3 Gaussian MIMO Wiretap Channel 

The Gaussian MIMO wiretap channel is defined by 

Y = HyX + Ny (13) 

Z = HzX + N^ (14) 

where the channel input X is a t x 1 vector, Y is an ry x 1 column vector denoting the 
legitimate user's observation, Z is an r^ x 1 column vector denoting the eavesdropper's 
observation, Hy,H^ are the channel gain matrices of sizes ty x t,rz x t, respectively, and 
Ny , N^ are Gaussian random vectors with covariance matrices Sy , Sjj; respectively, which 
are assumed to be strictly positive-definite, i.e., Sy >- 0, S^ >- 0. We consider a covariance 
constraint on the channel input as follows 

E [XX^] ^ S (15) 

where S ^ 0. The capacity-equivocation region of the Gaussian MIMO wiretap channel is 
denoted by C(S), and is stated in the following theorem. 

Theorem 3 The capacity- equivocation region of the Gaussian MIMO wiretap channel C(S) 
is given by the union of rate triples {Ro,Ri, Re) satisfying 

1 |HyKHj: + Sy| 1 |HzKH^ + Sz| .^„. 

Z |Zjy I Z \Zjz\ 

1 |HyKHT + Sy| 

Ro + Ri < t: log 



2 ° IS 



Y\ 



1 |HySHy -|- Sy| 1 |H^SH^ 

2 °^ iHyKHf + Sy|' 2 °^ iHzKHj + S^| 



+ min <^ - log I-I-— ^— J^, - log ±-±^—-±1- (17) 



. ri |HySH^ + Sy| 1 |H^SHT + S^| ) 
itn < mm < - log -; ^ r , - log ■; T ;- r 18 

°- \2 ^ |HyKHj + Sy|'2 ^|H^KHT + Sz|J ^ ' 

for some positive semi-definite matrix K such that ^ K ^ S. 

Similar to what we did in the previous section, we can establish an alternative statement for 
Theorem [3] by considering the Gaussian MIMO wiretap channel with public messages, where 
the legitimate user's private message is divided into two parts such that one part (confidential 
message) needs to be transmitted in perfect secrecy and there is no secrecy constraint on the 
other part (public message). The capacity region for this alternative scenario is denoted by 
Cp{S), and can be obtained by using Lemma [1] and Theorem [3] as stated in the next theorem. 



"'^ Without loss of generality, we can set Sy = S^ = I. However, we let Sy, S^ be arbitrary for ease of 
presentation. 



Theorem 4 The capacity region of the Gaussian MIMO wiretap channel with public mes- 
sages Cp{S) is given by the union of rate triples {Rq, Rp, Rg) satisfying 



0<Rs<-log ^ ^ ,^^, ^' --log ' ^ ,^^, — ^ (19) 



— o 1 1 log 1 

1 , iHyKHj + S5 



Ro + Rp + Rs< -log ' i^^^i 



. jl, |HySHy + Sy| 1 IH^SH^ + S^I , 

+ "^^" ^ 2 ^"" iHyKHT + Syr 2 ^°S |H,KHT + S,| ^ ^'^^ 



1 HySH-ix + Sy 1 H^SH^ + S; 
- log ■; T r , - log ■; ^ 

2 ^ |HyKHj + Sy|'2 ^ iHzKH^ 



i?o < mill - log ',' ^^ ' - log '/^^^/t " (21) 



/or some positive semi-definite matrix K such that ^ K ^ S. 

We next define a sub-class of Gaussian MIMO wiretap channels called the aligned Gaus- 
sian MIMO wiretap channel, which can be obtained from flT3|) - flT^ by setting Hy = Hz = I? 

Y = X + Ny (22) 

Z = X + Nz (23) 

In this work, we first prove Theorems |3] and H] for the aligned Gaussian MIMO wiretap 
channel. Then, we establish the capacity region for the general channel model in (fT3|) - (fT^ 
by following the analysis in Section V.B of |Jj and Section 7.1 of [12] in conjunction with the 
capacity result we obtain for the aligned channel. 

3.1 Capacity Region under a Power Constraint 

We note that the covariance constraint on the channel input in (IT5|) is a rather general 
constraint that subsumes the average power constraint 

E [X^X] = tr {E [XX^] ) < P (24) 

as a special case, see Lemma 1 and Corollary 1 of [2J. Therefore, using Theorem [3l the 
capacity-equivocation region arising from the average power constraint in (12^ . C{P), can be 
found as follows. 

Corollary 1 The capacity- equivocation region of the Gaussian MIMO wiretap channel sub- 
ject to an average power constraint P, C{P), is given by the union of rate triples {Rq, Ri, Re) 



satisfying 



1, iHyKiHj + Syl 1 iHzKiHl + S; 



< i?e < - log r^^ log -— (25) 

Z \-^Y I ^ \^Z\ 

1 iHyKiHj + Syl 



2 " |Sy| 

"Ij |Hy(Ki + K2)H;r^Sy| Ij |Hz(Ki + K2)H; + 
2 °^ |HyKiHj + Ey| '2 °^ iHzKiHj + Szl 



Ij |Hy(Ki + K2)H^ + Sy| 1^ |Hz(Ki + K2)H^ + S, 
2°^ |HyKiHf + Ey| '2°^ |HzKiHT + Sz| 



jor some positive semi- definite matrices Ki, K2 such that tr(Ki + K2) < P. 



4 Proof of Theorem [3] for the Ahgned Case 

Instead of proving Theorem [3], here we prove Theorem HI which implies Theorem [3] due to 
Lemma [H Achievability of the region given in Theorem H] can be shown by setting y = X 
in Theorem [2], and using jointly Gaussian ([/, X = U -\-T), where U,T are independent 
Gaussian random vectors with covariance matrices S — K, K, respectively. In the rest of this 
section, we provide the converse proof. To this end, we note that since Cp(S) is convex by 
definition, it can be characterized by solving the following optimization probleno 

/(i?o) = ^ max fipRp + fi^Rs (29) 

for all lip G [0, oo), fi^ G [0, oo), and all possible common message rates Rq, which is bounded 
as follows 

0<Ro< min{C7y(S), Cz(S)} (30) 

where Cy(S), Cz(S) are the single-user capacities for the legitimate user and the eavesdrop- 
per channels, respectively, i.e., 

Cy (S) = ^ log i^±^ (31) 

Z |2jy I 

Gz(S) = ilogi^±^ (32) 



^Although characterizing Cp(S) by solving the following optimization problem 

max Mo^o + fJ'vRv + ^J-sRs (28) 

(flo,flp,-Ra)GCp(S) 

for all fiQ, fip, fis seems to be more natural, we find working with (|29p more convenient. Here, we characterize 
Cp(S) by solving p9)) for all Hp,fis, for all fixed feasible Rq. 



We note that the optimization problem in (|29|) can be expressed in the following more explicit 
form 

f(Rn) = max /in-Rr, + UsRs (33) 

£;[xxT]^s 

f 0<i?, < J(y;Y|[/)-/(y;Z|[/) 

s.tJ R* + R^ + R^ < I{V;Y\U)+mm{I{U;Y),I{U;Z)} (34) 

[ i?* < mm{I{U-Y),I{U-Z)} 

We also consider the Gaussian rate region 7?.'^(S) which is defined as 

r 0<Rs < Rs(K) 

n^(S) = \(R R R)- ^o + ^P + ^^ ^ /2.(K) + i?,(K) + min{i?oy(K),i?oz(K)} 
^ °' " '^' i?o < min{i?or(K),i?oz(K)} 



for some ^ K ^ S 



where RgiK.), Rp(K.),Rqy(K.),Rqz(K.) are given as follows 



(35) 



Rs (K) = - log log (36) 

z l-^y I -^ \^z\ 

i?,(K) = llog^i±^ (37) 

z l-i^ + ^z| 

To provide the converse proof, i.e., to prove the optimality of jointly Gaussian ilJ^V = X) 
for the optimization problem in (!33|) -( 1M|) . we will show that 

fiR*) = giR*), 0<R;< min{Cy(S), Cz(S)} (40) 

where g{Ro) is defined as 

5f(i?o) = , max fipRp + n^Rs (41) 

We show fHU]) in two parts: 

• f^s < fJ-p 



4.1 lis < lip 

In this case, /(i?o) ^^^ be written as 

f{R*o)= max /ip(i?p + i?,) (42) 

e[xxt]^s 

^ f i?S + i?p + i?s < /(X;Y|[/)+min{/(t/;Y),/(f/;Z)} 
'■ ■[ i?* < min{/(t/;Y),/(t/;Z)} 

where we use the fact that Hs <: fJ-p, and the secret message rate Rg can be given up in favor 
of the private message rate Rp. This optimization problem gives us the capacity region of the 
two-user Gaussian MIMO broadcast channel with degraded message sets, where a common 
message is sent to both users, and a private message, on which there is no secrecy constraint, 
is sent to one of the two users [13]. The optimization problem for this case given in (1421) - (1431) 
is solved in |10j by showing the optimality of jointly Gaussian (t/, X), i.e., /(-Rq) — di^o)- 
This completes the converse proof for the case /i^ < P-p- 

4.2 Up < lis 

In this case, we first study the optimization problem in (HTj) . We rewrite 5'(-Ro) ^^ follows 

9{Rl) = max iipRp + /i,i?,(K) (44) 

^^ i R*o + Rp < i?p(K) + min{i?oy(K),i?oz(K)} 
^' ■ \ R*o < min{/?oy(K),i?oz(K)} 

Let (K*, R*) be the maximizer for this optimization problem. The necessary KKT conditions 
that (K*, R*) needs to satisfy are given in the following lemma. 

Lemma 2 K* needs to satisfy 

ills - /ipA - /3y){K* + Ey)-i + M = (/i, - fipX + /3z)(K* + S^)"' + M^ (46) 
for some positive semi-definite matrices M, M5 such that 

K*M = MK* = (47) 

(S - K*)Ms = MsiS - K*) = (48) 



and for some A = 1 — A such that it satisfies < A < 1 and 



= if Roy{K*) > Roz{K* 

Xl = 1 if RoyCK*) < Roz{K* 

7^ 0,1 if Roy{K*) = Roz{K* 



(49) 



and {j3y-,Pz) are given as follows 



Wy,I3z)= { 



(0,0) 
(0,>0) 
(>0,0) 
I (>0,>0) 



if i?*<min{i?oy(K*),/?oz(K*)} 

if Rl = i?oz(K*) < i?oy(K*) 

if Rl = i?oy(K*) < i?oz(K*) 

if i?* = i?oy(K*) = i?oz(K*) 



(50) 



Rp needs to satify 



R; = Rp{K*) + min{i?oy(K*), i?oz(K*)} - R^ 

The proof of Lemma [2] is given in Appendix [Bl We treat three cases separately: 
• Rl<mm{RoY{K*),RoziK*)} 

• RX = RnYiK*) < Raz(K*) 



(51) 



. Rl = Roz{K*) < Roy{K*) 

4.2.1 Rl < min{i?oy(K*), i?oz(K*)} 

In this case, we have /3y = /3z = 0, see fl50l) . Thus, the KKT condition in P6l) reduces to 



(//, - fipX){K* + Sy)-i + M = (/i, - /ipA)(K* + S^)-! + M5 



(52) 



We first note that K* satisfying (|52|) achieves the secrecy capacity of this Gaussian MIMO 
wiretap channel 



Rl = Rs{K* 
= CsiS) 



1 |K + I]y| 

max - log ; ; — 

0:<K^S 2 Sy 



1, |K + S;,| 
- log — — — - — 
2 ^ Sz 



(53) 
(54) 

(55) 



Next, we define a new covariance matrix S^ as follows 



ifis - ^pA)(K* + tzr' = ifis - /ipA)(K* + S^)-^ + Ms 



(56) 



10 



This new covariance matrix "Sz has some useful properties which are hsted in the following 
lemma. 

Lemma 3 We have the following facts. 

. tz<T.z 

• Sz ^ Sy 

• (K* + tz^HS + tz) = (K* + Sz)-i(S + Sz) 

The proof of Lemma [3] is given in Appendix O Thus, we have 

1 \S + tz\ ,,^. 

= - log ^- (58) 

> - log i^±^ (59) 

= Roy{K*) (60) 

where (I58p comes from the third part of Lemma [31 (1591) is due to the fact that 

|A + B + A|^^+^ (61) 



|B + A| - |B, 
for A ^ 0, A ^ 0, B :^ by noting the second part of Lemma [3l Therefore, we have 

Roz{K*) > i?oy(K*) (62) 

where K* satisfies ([52]). Using ([62]) in ([51]), we find i?* as follows 

R; = Rp{K*) + Roy{K*) - R* (63) 

We also note the following 

R*o + R; + R: = RoyCK*) + R^iK*) + R,{K*) (64) 

1 |S + Sy| 

= - log (65) 

Z \-^Y I 

= Cy(S) (66) 

Now, we show that 

g{Rl) = /(i?*) (67) 

11 



) 



To this end, we assume that 

giR*,) < /(i?*) (68) 

which imphes that there exists a rate triple {Rq, R° R°) G Cp(S) such that 

^ipRl + iisK < ^pRp + f^sR" (69) 

To prove (1671) . i.e., that (168|) is not possible, we note the following bounds 

R" < Cs{S) = R: (70) 

Rp + R° < Cy(S) — Rq = Rp + Rg (71) 

where (!70l) conies from ( l55l) and the fact that the rate of the confidential message, i.e., Rg, 
cannot exceed the secrecy capacity, and (I7T1) is due to fl66|) and the fact that the sum rate 
Rq + Rp + Rs cannot exceed the legitimate user's single-user capacity. Thus, in view of 
fis > /ip, m-^ imply 

fipR; + /i,/?: < fipR; + fisR: (72) 

which contradicts with ( l69l) : proving ( l67l) . This completes the converse proof for this case. 

Before starting the proofs of the other two cases, we now recap our proof for the case 
Rq < min{/2oy(K*), i?oz(K*)}. We note that we did not show the optimality of Gaussian 
signalling directly, instead, we prove it indirectly by showing the following 

g{R*Q) = /(i?*) (73) 

First, we show that for the given common message rate Rq, we can achieve the secrecy 
capacity, i.e., R* = Cs{S), see (153|) - (!55|) . In other words, we show that {Rq,0,R*) is on 
the boundary of the capacity region Cp(S). Secondly, we show that for the given common 
message rate Rq, {R*, R*) achieve the sum capacity of the pubhc and confidential messages, 
i.e., R* + Rp is sum rate optimal for the given common message rate Rq, see flMl) - (l66l) and 
flTTj) . These two findings lead to the inequalities in fl70l) - fl7Tl) . Finally, we use a time-sharing 
argument for these two inequalities in (I70l) -( I7T|) to obtain ( 1731) . which completes the proof. 

4.2.2 R*Q = RoyCK*) < RoziK*) 

We first rewrite the KKT condition in (1461) as follows 



{^s - ^ip\ - /io/3)(K* + Ey)-! + M = (/i, - ^p\ + /io/9)(K* + S^)"' + Ms (74) 



12 



by defining ^o = (^y + l^z, l^o^ = Py, and hq(5 = (3z- We note that if Roy(K*) < Roz(K*), 
we liave ^ = A = 1, if i?oy(K*) = Roz(K*), we have < A < 1,0 < /3 < 1. The proof of 
these two cases are very similar, and we consider only the case 0<A<1,0</3<1, i.e., 
we assume Roy(K*) = -Roz(K*). The other case can be proved similarly. 
Similar to Section 14.2. ![ here also, we prove the desired identity 

g{R;) = /(i?S) (75) 

by contradiction. We first assume that 

g{R;) < /(i?S) (76) 

which implies that there exists a rate triple {Rq, i?°, R°) G Cp(S) such that 

fipRp + fJ,sR*s < fJ-pRp + fJ'sR°s (77) 

where we define R* = Rs{K.*). Since the sum rate Rq + Rp + Rg needs to be smaller than 
the legitimate user's single user capacity, we have 

i?* + i?° + i?°<Cy(S) (78) 

On the other hand, we have the following 

R; + R; + R: = mm{RoY{'K*),Roz{K*)} + Rp{K*) + i?,(K*) (79) 

= RoyCK*) + Rp{K*) + i?,(K*) (80) 

= Cy(S) (81) 

where (1791) comes from (ISTl) . and ( IHOl) is due to our assumption that Rq = Rqy(K*) = 
Roz(K*). Equations ([78]) and (EI]) imply that 

r; + r:<r; + r: (82) 

In the rest of this section, we prove that we have R° < R* for the given common message 
rate Rq, which, in conjunction with fl82]) . will yield a contradiction with (I77|) : proving fl75]) . 
To this end, we first define a new covariance matrix Sy as follows 

ifi, - /ipA)(K* + Sy)-i = (/i, - fipX){K* + Sy)-i + M (83) 

This new covariance matrix Sy has some useful properties which are listed in the following 
lemma. 

Lemma 4 We have the following facts. 

13 



• (K* + tyy^ty = (K* + Sy)-lS 



Y 



The proof of this lemma is given in Appendix [Dl Using this new covariance matrix, we define 
a random vector Y as 

Y = X + Ny (84) 

where Ny is a Gaussian random vector with covariance matrix Sy. Due to the first and 
second statements of Lemma HI we have the following Markov chains 

?7^1/-^X^Y^Y (85) 

f/^y^X^Y^Z (86) 

We next study the following optimization problem 

max fioRo + (/^s - /U„A)i?s 

iRo,Rp,Rs)eCp{S) 

max fio mm{I{U; Y),I{U; Z)} + (^, - fi^X) [I{V; Y\U) - I{V; Z\U)] (87) 

(7^V-i-X-i.{Y,Z) 

e[xxt]^s 
Since we assume {Rq, R°, R°) G Cp(S), we have the following lower bound for (IHTl) 

^0^0 + if^s - f^p>^)R° < max /io-Ro + {l^s - fJ'p^jRs (88) 

{-Ro:-Rp,-Rs)GCp(S) 
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Now we solve the optimization problem in (187|) as follows 



max IJ-oRq + ifJ-s — fJ'v^)Rs 

{Ro,Rp,Rs)eCp(S) 

max fiomm{I{U;Y),I{U;Z)} + {fis-^pX)[IiV;Y\U)-IiV;Z\U)] (89) 

s[xxT]^s 

< max fio^I{U; Z) + fiol3I{U; Y) + (/i, - /i^A) [/(V; Y|t/) - I{V; Z\U)] (90) 
c— >■ y-i-x-> ( Y, z) 

£[xxT]^s 

< max /xoM?7;Z) + /io/3/(f/;Y) + (^,-/ipA) [/(y;Y| [/)-/(!/; Z I [/)] (91) 

Efxx^l^s 



< max fiof3IiU;Z)+iJoi3I{U;Y) + {fis-lJpX) /(X; Y|[/) - J(X; Z|?7) 

C/-s-X-s-(Y,Z) L 



(92) 



< loe -; r H loe -; r H ^^ 



, |K* + Sy| , IK^ + S^I 
log — ^^r-^ log — TFrn — 



'Y\ 



lio^Roz{K*) + fio(3RoY{^* 



lio^Roz{K*) + fio/3RoY{K*) + 



fJ-s " fJ-pX 



l-l's — fJ-pX 



, |K* + Sy| , |K* + Sz 

log ^3— log ■ 



■'Yl 



, |K* + Sy| 

log — — — log 



|Sz| 
K^ + S^l 



'Y\ 



fio/3Roz{^*) + fio/3RoYi^*) + (/is - f^pX)RsiK*) 



(93) 
(94) 

(95) 

(96) 
(97) 



where (190]) comes from the fact that 0</3 = l-/3<l, (|9T])-(l92]) are due to the Markov 
chains in fl85|) -f l86|) . respectively, (|93|) can be obtained by using the analysis in [9l eqns (30)- 
(32)], f l95|) comes from the third part of Lemma HI and ( 197|) is due to our assumption that 
R*Q = i?oy(K*) = RoziK*). Thus, (ET]) implies 



max noRo + ifJ-s - fJ'pX)Rs < I-IoRq + (/"s - fJ'pX)R* 

{Ro,Rp,Rs)£Cp{S) 



(98) 



Comparing ( 188|) and ( 198|) yields 






(99) 



Using ( |82|) and ( |99|) and noting /ig > /ip, we can get 



/ip-Rp + fJ.sR° < /ip-Rp + fJ-sRl 



(100) 



which contradicts with (!77|) : proving f l75|) . This completes the converse proof for this case. 
Before providing the proof for the last case, we recap our proof for the case R^ = 
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i?oy(K*) < Roz(K*). Similar to Section H:.2.H here also, we prove the optimality of Gaussian 
signalling indirectly, i.e., we show the desired identity 

giR*,) = /(i?*) (101) 

indirectly. First, we show that for the given common message rate Rq, R* + R* is sum rate 
optimal, i.e., {R*,R*) achieve the sum capacity of the public and confidential messages, by 
obtaining (1821) . Secondly, we show that (i?Q,0,/?*) is also on the boundary of the capacity 
region Cp(S) by obtaining fl98l) . These two findings give us the inequalities in fl82|) and 
fl99|) . Finally, we use a time-sharing argument for these two inequalities in (|82|) and (|99|1 to 
establish (llOip . which completes the proof. 

4.2.3 R* = RozCK*) < RoviK*) 

In this case, we have A = /3y = 0, see (H9l)-(l50l). Hence, the KKT condition in ( l46l) reduces 
to 

//,(K* + Sy)-i + M = (/i, + f3z){K* + Sz)-^ + Ms (102) 

We again prove the desired identity 

giR^) = /(i?*) (103) 

by contradiction. We first assume that 

giR*,) < fiR*) (104) 

which implies that there exists a rate triple {Rq, R", R") G Cp(S) such that 

^ipR; + /i,i?: < fipR; + fisR° (105) 

In the rest of the section, we show that 

fipR; + fi,R: > fipR; + fi.R': (106) 

to reach a contradiction, and hence, prove (11031) . To this end, we define a new covariance 
matrix Sy as follows 

A(,(K* + Sy)-i = /i,(K* + Sy)-i + M (107) 

This new covariance matrix Sy has some useful properties listed in the following lemma. 
Lemma 5 We have the following facts. 
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• Sy ^ Ey 

• Sy ^ S^ 

• (K* + tyy^ty = (K* + 1:y)-^'Sy 

The proof of this lemma is very similar to the proof Lemma HI and hence is omitted. Using 
this new covariance matrix Sy, we define a random vector Y as 

Y = X + Ny (108) 

where Ny is a Gaussian random vector with covariance matrix Xly. Due to the first and 
second statements of Lemma [5l we have the following Markov chains 

t/^y^X^Y^Y (109) 

[/^\/^X^Y^Z (110) 

Next, we study the following optimization problem 

max {np + Pz)Ro + fJ'pRp + IJ-sRs (HI) 

We note that since {Rq, R°, R°) G Cp(S), we have the following lower bound for the opti- 
mization problem in (lllip 

{lip + l3z)Rl + fJipRl + lJisR°< max {^p + Pz)Rq + ^ipRp + fisRs (112) 

(-Ro ,-Rp ,-Rs )£Cp (S) 

We next obtain the maximum for (lllip . To this end, we introduce the following lemma 
which provides an explicit form for this optimization problem. 

Lemma 6 For fig > fip, we have 

max (^p + /3z)Ro + fJ-pRp + fJ-sRs 

(Ro,Rp,Rs)eCp{S) 

max {fip + (3z)mm{I{U;Y),I{U;Z)} + fipI{V;Z\U) 

(7-s>y-^X^(Y,Z) 

e[xxt]^s 

+ fis[I{V;Y\U)-I{V;Z\U)] (113) 

The proof of this lemma is given in Appendix [El 

Next we introduce the following extremal inequality from [3], which will be used subse- 
quently in the solution of (11131) . 

Lemma 7 ( [3, Corollary 4]) Let (f/, X) be an arbitrarily correlated random vector, where 
X has a covariance constraint E [XX^] < S and S ;^ 0. Let Ni,N2 be Gaussian random 
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vectors with covariance matrices I]i,I]2, respectively. They are independent of{U,^). Fur- 
thermore, Si,S2 satisfy Si :< S2- Assume that there exists a covariance matrix K* such 
that K* ^ S and 

j^(K* + Si)-i = 7(K* + S2)~' + M5 (114) 

where /^ > 0,7 > and Mg is positive semi-definite matrix such that (S — K*)M5 = 0. 
Then, for any ([/, X), we have 

iyh{X + Ni|[/) - 7/i(X + N2|[/) < ^ log |(27re)(K* + Si)| - |log |(27re)(K* + S2)| (115) 

Now we use Lemma [3 To this end, we note that using (I107p in (I102p . we get 

/i,(K* + Sy)-i = (/i, + l3z){K* + Sz)-' + Ms (116) 

In view of (11161) and the fact that Sy :< S^, Lemma [7] imphes 

/x,MY|t/) - (/i. + /3z)MZ|f/) < ^ log |(27re)(K* + Sy)| - ^^^^ log |(27re)(K* + S^)| 

(117) 



We now consider the maximization in (1113p as follows 



max {fip + /3z)Ro + fJ^pRp + f^sRs 

max {fip + Pz)mm{I{U;Y),I{U;Z)} + i^pI{V;Z\U) 

i7-i.y^X-^(Y,Z) 

£;[xxT]^s 

+ f,,[IiV;Y\U)-IiV;Z\U)] 

< max [fip + Pz)I{U; Z) + iJij,I{V- Z\U) + /i, [I{V- Y\U) - I{V; Z\U)] 
£;[xxT]^s 

< max ifip + /3z)I{U; Z) + //^/(X; Z\U) + fi^ [I{V; Y\U) - I{V; Z\U)] 
£;[xxT]^s 

< max ifip + /3z)I{U; Z) + ;UpJ(X; Z\U) + fi^ \l{V; Y\U) - I{V; Z\U) 
£;[xxT]^s 

< max (/ip + /3z)/(/7;Z) + /ip/(X;Z|[/) + //J/(X;Y|[/)-/(X;Z|[/) 

£;[xxT]^s 

= max {fip + (3z)h{Z)+fi,h(y\U)-if-is + Pz)hiZ\U) 

!7->X^{Y,Z) 

£;[xxT]^s 

- ^log|(27re)Sy| + ^^i^ log |(27re)S^| 

< ^^t^^ log |(27re)(S + Sz)| + max fish{Y\U) - (/i, + (3z)h{Z\U) 

£;[xxT]^s 

- ^log|(27re)Sy| + ^^^log |(2vre)Sz| 

< ^V±^iog |(2vre)(S + S^)| + ^log |(27re)(K* + Sy)| - ^^^±^ log |(2vre)(K* 

- ^log|(27re)Sy| + ^^i^log |(2vre)S^| 

= -^ log T 't H log : ; H log log ■ 



(118) 
(119) 

(120) 

(121) 

(122) 



(123) 



^Y\ 



(/ip + /3z)/?oz(K*) + //pi?p(K*) + ^ 



(/ip + /3z)i?oz(K*) + ^pi?p(K*) + 



\^s 



log 



log 



|K* + Sy| , |K* + Sz| 



|Sy| 
|Sy| 



-log 
-log 






(/xp + /3z)i?oz(K*) + ^p/?p(K*) + ^,i?,(K* 
(/ip + (3z)Ro + ^pRp + /^s-Rs 



(124) 

Sz)| 
(125) 

(126) 
(127) 

(128) 

(129) 
(130) 
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where flTT9|l is due to min{a, b} < a, flT20D is due to the Markov chain in flTTOj) . (IT2T|) -(IT22D 
come from the Markov chains in fllOQp - flllOl) . respectively, f ll24p is due to the maximum 
entropy theorem [T5], f ll25p comes from f lll7p . and (11280 is due to the third part of Lemma El 
Comparing f ll30p and flll2p yields 

^pR; + ^isK < fJ'pR; + f^sK (131) 

which contradicts with our assumption in f llOSP ; implying fllOSp . This completes the converse 
proof for this case. 

We note that contrary to Sections 14.2.11 and I4.2.2[ here we prove the optimality of Gaus- 
sian signalling, i.e., 

giRl) = /(i?*) (132) 

directly. In other words, to show ( ]132p . we did not find any other points on the boundary 
of the capacity region Cp(S) and did not have to use a time-sharing argument between these 
points to reach fll32p . (This was our strategy in Sections 14.2. II and 14.2.21 ) Instead, we define 
a new optimization problem given in flll3p whose solution yields fll32p . 

5 Proof of Theorem [3] for the General Case 

The achievability of the region given in Theorem [3] can be shown by computing the region 
in Theorem [1] with the following selection of {U, V, X): l^ = X, X = U + T where T, U 
are independent Gaussian random vectors with covariance matrices K, S — K, respectively, 
U = \J. In the rest of this section, we consider the converse proof. We first note that 
following the approaches in Section V.B of [2j and Section 7.1 of [Ij], it can be shown 
that a new Gaussian MIMO wiretap channel can be constructed from any Gaussian MIMO 
wiretap channel described by (TT3l)-(1T4p such that the new channel has the same capacity- 
equivocation region with the original one and in the new channel, both the legitimate user 
and the eavesdropper have the same number of antennas as the transmitter, i.e., ry = rz = t. 
Thus, without loss of generality, we assume that ry = rz = t. We next apply singular- value 
decomposition to the channel gain matrices Hy, Hz as follows 

Hy = UyAyVj (133) 

Uz = VzAz^l (134) 
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where Uy, U^, Vy, V^ are txt orthogonal matrices, and Ay, Az are diagonal matrices. We 
now define a new Gaussian MIMO wiretap channel as follows 



Y = HyX + Ny 

Z = H^X + Nz 



(135) 
(136) 



where Hy, Hz are defined as 



Hy = Uy(Ay + aI)Vj 

Uz = Vzi\z + «I)Vj 



(137) 
(138) 



for some a > 0. We denote the capacity-equivocation region of the Gaussian MIMO wire- 
tap channel defined in (ll35l) -( TT36l) by Cq,(S). Since HyjUz are invertible, the capacity- 
equivocation region of the channel in (I135l) - (ll36p is equal to the capacity-equivocation region 
of the following aligned channel 



Y = X + Hy Ny 

1 =X + H^"^Nv 



(139) 
(140) 



Thus, using the capacity result for the aligned case, which was proved in the previous section, 
we obtain Cq,(S) as the union of rate triples {Rq, Ri, Re) satisfying 



< i?, < - lo 



Ro + Ri<- log 




+ min < - log 



^log 



HySHy + Sy 



HvKHc 



HyKHy 



Ro < min { - log 



HySHy + Sy 



HyKHy 




(141) 



(142) 



(143) 



for some positive semi-definite matrix K such that ^ K ^ S. 

We next obtain an outer bound for the capacity-equivocation region of the original Gaus- 
sian MIMO wiretap channel in (TT3l) - (TT^ in terms of Cq,(S). To this end, we first note the 
following Markov chains 



X^ Y^ Y 
X^Z^Z 



(144) 
(145) 
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which imply that if the messages (Wq, Wi) with rates (i?o, Ri) are transmitted with a van- 
ishingly small probability of error in the original Gaussian MIMO wiretap channel given by 
(iT3l) -( 1T^ . they will be transmitted with a vanishingly small probability of error in the new 
Gaussian MIMO wiretap channel given by fll35p - fll36p as well. However, as opposed to the 
rates Rq, Ri, we cannot immediately conclude that if an equivocation rate R^ is achievable in 
the original Gaussian MIMO wiretap channel given in flT3|) - flT^ . it is also achievable in the 
new Gaussian MIMO wiretap channel in ( 1135p -( fT36l) . The reason for this is that both the 
legitimate user's and the eavesdropper's channel gain matrices are enhanced in the new chan- 
nel given by f ll35p -( IT36l) . see fll37p -( fT38l) and/or f ll44p -( in5l) . and consequently, it is not clear 
what the overall effect of these two enhancements on the equivocation rate will be. However, 
in the sequel, we show that if (i?o, -Ri, -Re) ^ C(S), then we have (i?o,-Ri,-Re — 7) ^ Cq,(S). 
This will let us write down an outer bound for C(S) in terms of Cq(S). To this end, we 
note that if [Rq, Ri, Re) G C(S), we need to have a random vector ([/, 1/, X) such that the 
inequalities given in Theorem [1] hold. Assume that we use the same random vector (f7, y, X) 
for the new Gaussian MIMO wiretap channel in f ll35p - fll36p . and achieve the rate triple 
{Rq, Ri, Re). Due to the Markov chains in ( 1144p -( IT45l) . we already have Ri < Ri,Ro < Rq- 
Furthermore, following the analysis in Section 4 of [H], we can bound the gap between Re 
and Re, i.e., 7, as follows 



^ = Re- Re < -log 



H^SH V + Sz 



^log 



iH^SHv + S^ 



(146) 



Thus, we have 



C(S)CC„(S) + ^(S) 



(147) 



where ^(S) is 



^(S) = {{0,0, Re 



: < i?e < - log 



H^SH V + Tiz 



1 , |H^SH^ + S^i 

- log ; ; 

2 ^ Sz 



148) 



Taking a — )■ in (I147p . we get 



C(S) C limC«(S) 

a— >0 



(149) 



where we use the fact that 



lim - log 

a^0 2 



H^SH^ + S^ 



1 |H^SH^ + S^l 

- log rrr— = 

2 ^ Sz 



(150) 



which follows from the continuity of log | ■ | in positive semi-definite matrices, and the fact 
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that UiiIq^oH^ = Hz- Finally, we note that 

limC„(S) (151) 



a->-0 



converges to the region given in Theorem [3] due to the continuity of log | ■ | in positive 
semi-definite matrices and limQ,_>oHy = Hy,limQ,_5.oH^ = Hz] completing the proof. 

6 Conclusions 

We study the Gaussian MIMO wiretap channel in which a common message is sent to both 
the legitimate user and the eavesdropper in addition to the private message sent only to 
the legitimate user. We first establish an equivalence between this original definition of the 
wiretap channel and the wiretap channel with public messages, in which the private message 
is divided into two parts as the confidential message, which needs to be transmitted in 
perfect secrecy, and public message, on which there is no secrecy constraint. We next obtain 
capacity regions for both cases. We show that it is sufficient to consider jointly Gaussian 
auxiliary random variables and channel input to evaluate the single-letter description of the 
capacity-equivocation region due to pLj. We prove this by using channel enhancement [2] 
and an extremal inequality from [3]. 

A Proof of Lemma [1] 

The proof of this lemma for Rq = Ois outlined in [U Problem 33-c], [5J. We extend their proof 
to the general case of interest here. We first note the inclusion Cp C C, which follows from 
the fact that if (i?o, Rp, Rs) ^ Cp, we can attain the rate triple {Rq, Ri = Rs + Rp, Re = Rs), 
i.e., {Ro, Rs + Rp, Rs) £ C. To show the reverse inclusion, we use the achievability proof for 
Theorem [1] given in [Ij. According to this achievable scheme, Wi can be divided into two 
parts as Wi = (Wp, Ws) with rates (i?i — Re, Re), respectively, and we have 

H{W,\Wo, Z^) = H{Wp, WslZ'^, Wo) (152) 

>H{Ws\Z'',Wo) (153) 

> H{Ws) - nj^ (154) 

for some 7„ which satisfies lim„_j,oo 7n = 0. Hence, using this capacity achieving scheme for 
C, we can attain the rate triple {Ro,Rp = Ri — Re,Rs = Re) £ Cp. This implies C C Cp] 
completing the proof of the lemma. 
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B Proof of Lemma [2 



Since the program in ( l44l) -( H5l) is not necessarily convex, the KKT conditions are necessary 
but not sufficient. The Lagrangian for this optimization problem is given by 

£ = fXsRsiK) + fXpRp + Xy [Rp{K) + i?oy(K) - Rp - i?*] + Xz [i?p(K) + i?oz(K) ~ Rp - R^] 
+ (3y [i?oy (K) - Rl] + Pz [i?oz(K) - i?*] + tr(KM) + tr((S - K)M5) (155) 

where M, M5 are positive semi-definite matrices, and Ay > 0, A^ > 0, /3y > 0, /3z > 0. 
The necessary KKT conditions that they need to satisfy are given as follows 

dC 

'r.=ri = (156) 



dRp '"■^-"■'' 

Vk>C |k=k. = (157) 

tr(K*M) = (158) 

tr((S - K*)ms) = (159) 

Ay [RpiK*) + Roy{K*) -R;-R*]=0 (160) 

Xz [RpiK*) + i?oz(K*) -R;-R*]=0 (161) 

/5y(i?oy(K*) -R*o) = (162) 

/3z(i?oz(K*) -R*o) = (163) 

The first KKT condition in (I156P implies Ay + A^ = fip. We define Ay = /ipA, Xz = fJ-pX and 
consequently, we have 0<A = 1 — A<1. The second KKT condition in (11571) implies (H6|) . 
Since tr(AB) = tr(BA) and tr(AB) > for A ^ 0, B ^ 0, flT58D - flT59l) imply (HTD-dlH!). The 
KKT conditions in (I160p - (I161I) imply (ISTl) . Furthermore, the KKT conditions in (ll60p -( fT6Tl) 
state the conditions that if i?oy(K*) > i?oz(K*), A = 0, if i?oy(K*) < i?oz(K*), A = 1, and 
if i?oy(K*) = i?oz(K*), A is arbitrary, i.e., < A < 1. Similarly, the KKT conditions in 
(USD- ([163]) imply §0^. 



C Proof of Lemma [3 

We note the following identities 



(/i, - fipX)iK* + tz)-' = ifis - /ipA)(K* + llz)-' + Ms (164) 

(/i, - fipX){K* + tz)-' = {^ls - /ipA)(K* + Sy)-i + M (165) 
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where fll64p is due to (156|) . and (11651) is obtained by plugging (11641) into (152|) . Since M ^ 
0,M5 y 0, (ITMl) - (IT65l) implies 



(/i, - ^pA)(K* + S^)-i ^ (/i, - fi,X){K* + S^)-i 



(166) 
(167) 



Using the fact that for A ^ 0, B ^ 0, if A ^ B, then A^^ >z B^ in f lT66|) - flT671) . we can get 
the first and second parts of Lemma [31 We next show the third part of Lemma [3] as follows 



(K* + S^)-^(S + S^) = I + (K* + tz)-\S - K*] 



1 + 



fK* 



/^s ~ l^pX 



-Mc 



fS-K* 



I + (K* + S2)-^(S-K* 
(K* + Sz)-i(S + Sz) 



where (I169p is due to (11641) . and (11701) comes from 



The proof is complete. 



(168) 
(169) 

(170) 
(171) 



D Proof of Lemma 14 



We note the following 

ifis - M)(K* + Sy)-i = (/i, - fipX)(K* + Sy)-i + M (172) 

ifis - /ipA)(K* + Sy)-i = (/i, - fipX + /io^)(K* + Sz)-' + /io/3(K* + Sy)-i + Ms (173) 



where flT72ll is ^, and fITTHD comes from plugging flT72D into (El). Since M ^ 0, flT72D 
implies 



ifls - /ipA)(K* + Sy)-1 ^ (/i, - /ipA)(K* + Sy)-^ 



(174) 



Using the fact that for A ^ 0, B ;- 0, if A ^ B, then A"^ y B^ in flTTiD yields the first 
statement of the lemma. Since 0</3=l — /?<1 and M5 ^ 0, (I173p implies 



(/i, - ^pA)(K* + Sy)-i h (/i. - /ipA)(K* + S^)-! 



(175) 
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Using the fact that for A :^ 0, B :^ 0, if A ^ B, then A"^ ^ B"Mn f ll75p yields the second 
statement of the lemma. We next consider the third statement of this lemma as follows 

(K* + Sy)-^Sy = I-(K* + Sy)-^K* (176) 



I- 






K* (177) 



I-(K* + Sy)"^K* (178) 

(K* + Sy)-lSy (179) 



where (11771) is due to (11721) and (I178p comes from 



E Proof of Lemma [6 



The optimization problem in (I113P can be written as 

max fisRs + UpRp + [fip + (5z)Ro (180) 

c/^y^x^(Y,z) 

b[xxt]^s 

f o<i?, < i{y-Y\u)-i{y-z\u) 

s.tJ R^ + R^ + Rq < I{V;Y\U) + mm{I{U;Y),I{U;Z)} (181) 

[ Ro < min{/(t/;Y),/(f/;Z)} 

For a given {U, V, X), we can rewrite the cost function in (I180p as follows 

fJ-sRs + fJ'pRp + ifJ'p + Pz)Ro 

< fisRs + fip[I{V; Y\U) + min{/(f/; Y), I{U; Z)} - i?, - Ro] + (/ip + /?z)i?o (182) 
= ifis - ^lp)Rs + ^lp[I{V■, Y\U) + mm{I{U; Y),I{U; Z)}] + PzRo (183) 

< (/i, - fip)[I{V; Y\U) - liV- Z\U)]+ iip[I{y- Y\U) + min{/(f/; Y), /([/; Z)}] + PzRo 

(184) 

= ^ls[I{V■, Y\U) - I{V- Z\U)] + ^lp[I{V■ Z\U) + min{/([/; Y), /(f/; Z)}] + ^zRo (185) 

< ^^s[I{y■ Y\U) - liV- Z\U)]+ iip[I{y- Z\U) + min{I{U- Y),I{U; Z)}] 

+ /3zmm{I{U;Y),I{U;Z)} (186) 

= fis[I{V; Y\U) - I{V; Z\U)] + fipI{V; Z\U) + (^^ + fiz) mm{I{U; Y),I{U; Z)} (187) 

where ( 1182p comes from the second constraint in ( ]18ip . ( ]184p is due to the first constraint 
in (11811) and the assumption fig > fip, and (I186p comes from the third constraint in (I18ip . 
The proof can be concluded by noting that the upper bound on the cost function given in 
(I187P is attainable. 
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